TROPICAL POLYHEDRA ARE EQUIVALENT TO MEAN PAYOFF GAMES 



MARIANNE AKIAN, STEPHANE GAUBERT, AND ALEXANDER GUTERMAN 



Abstract. We show that several decision problems originating from max-plus or tropical convexity are 
equivalent to zero-sum two player game problems. In particular, we set up an equivalence between the 
external representation of tropical convex sets and zero-sum stochastic games, in which tropical polyhedra 
correspond to deterministic games with finite action spaces. Then, we show that the winning initial positions 
can be determined from the associated tropical polyhedron. We obtain as a corollary a game theoretical 
proof of the fact that the tropical rank of a matrix, defined as the maximal size of a submatrix for which 
the optimal assignment problem has a unique solution, coincides with the maximal number of rows (or 
columns) of the matrix which are linearly independent in the tropical sense. Our proofs rely on techniques 
from non-linear Perron-Frobenius theory. 

1. Introduction 

1.1. Statement of the problems and main results. The three following problems are basic in max-plus 
or tropical algebra. 

Problem 1.1 (Is a tropical polyhedral cone non-trivial?). Given m x n matrices A = (Aij) and B ~ (Bij) 
with entries m K U {— cxd}, does there exist a vector a; S (M U {— oo})" non- identically —oo such that the 
inequality "Ax ^ Bx" holds in the tropical sense, i.e., 

(1) max (Ay + Xj) ^ max (i3ij + Xj), Vi E [m] ? 

jG[n] jG[n] 

Here and in the sequel, we use the notation [n] := {1, . . . , 7i}. 

Problem 1.2 (Is a tropical polyhedron empty?). Given m x n matrices A ~ (Aij) and B ^ (Bij) with 
entries m M U {— oo}, and two vectors c,d of dimension m with entries in RU {— cxd}, does there exist a 
vector a; G (M U {— oo})" .such that the inequality "Ax -f c ^ Bx + d" holds in the tropical sense, i.e., 

(2) max ( max(ylij +Xj),Ci) ^ max(max(_Bij + Xj),di) , Vi G [m] ? 

je[n] je[n] 

Problem 1.3 (Is a family of vectors tropically dependent?). Given m ^ n and an m x n matrix A = (Aij) 
with entries in M U {— oo}, are the columns of A tropically linearly dependent? I.e., can we find scalars 
Xi, . . . ,Xn G K U { — oo}, not all equal to — oo, .such that the equation "Ax ~ 0" holds in the tropical sense, 
meaninq that for every value of i £ [m] , when evaluatinq the expression 

max( Ay + Xj ) 

the maximum is attained by at least two values of j ? 

The representation of a tropical polyhedral cone by inequalities turns out to be equivalent to the de- 
scription of a mean payoff game by a bipartite directed graph in which the weights indicate the payments 
(the weighted graph is coded by the matrices A and B). More generally, we consider an infinite system of 
inequalities, the set [to] being replaced by an infinite set in ([T]). The set P of solutions of this system is now a 



Date: December 4, 2009; Revised: April 25, 2011; June 9, 2011. 

2010 Mathematics Subject Classification. Primary 14T05; Secondary 91A50. 

The two first authors were partially supported by the joint RFBR-CNRS grant 05-01-02807, by a MSRI Research membership 
for the Fall 2009 Semester on Tropical Geometry, and by a grant from LEA (Laboratoire Europeen Associe) MathMode. The 
second author was also partially supported by the Arpege programme of the French National Agency of Research (ANR), 
project "ASOPT", number ANR-08-SEGI-005 and by the Digiteo project DIM08 "PASO" number 3389. The third author was 
partially supported by the invited professors program from INRIA Paris-Rocquencourt and by the grants MD-2535. 2009.1 and 
RFBR 09-01-00303. 



1 



tropical convex cone (not necessarily polyhedral), and we associate to it a mean payoff game with an infinite 
set of actions, corresponding to defining half-spaces. We shall see that such infinite systems of inequalities 
represent in particular stochastic mean payoff (zero-sum) games. 

Our main results set up a correspondence between the external representation (by inequalities) of a tropical 
convex cone P, and mean payoff games with infinite action spaces on one side, in which 

3u £ P, u ^ ~oo there is at least one winning initial state. 

Moreover, when P is polyhedral, the actions spaces becomes finite, and 

3u G P, Ui ^ — oo <^ I is a winning initial state, 

see Theorems I3.1l and l3.2l This shows that Problem 1 1.11 and its affine version. Problem II. 2 [ are (polynomial- 
time) equivalent to mean payoff game problems. We show by the same techniques that Problem 11.31 reduces 
to a mean payoff game problem, and derive theoretical results concerning tropical linear dependence by game 
techniques. 

Before discussing further these results, we give more background. Note that some of the present results 
were announced in the conference paper |AGG10a| . without proofs. 

1.2. Motivation. The first two problems concern max-plus or tropical convex sets. The latter are subsets 
C of (M U {-oo})" such that 

u,v<eC, A,^ e M U {-oo}, max(A, /i)=0 =^ {\ + u) V {^i + v) e C 

where "V" is the supremum operator for the partial order of RU{— oo}, that is the "max" applied entry wise, 
and where X + u denotes the vector obtained by adding the scalar A to every entry of u. 

Max-plus or tropical convexity has been developed by several researchers under different names. It goes 
back at least to the work of Zimmermann jZim77| . It was studied by Litvinov, Maslov, and Shpiz jLMSOl], 
in relation to problems of calculus of variations, and by Cohen, Gaubert, and Quadrat |CGQOH |CGQ04| , 
motivated by discrete event system problems |CGQ99 . Max-plus polyhedra have appeared in tropical 



geometry after the work of Develin and Sturmfels |DS04j . followed by several works including the ones of 
Joswig and Yu, see [JojOll [JSY OTj . Recent works on the subject include |BH04l lBY06l IGK071 IBSS071 iNSOTl 
[foi09l IGK091 IGMlOl EGKTTi| . 

As it is shown in |GK11| (see also jGP97|[GK09| ) max-plus polyhedra can be defined equivalently in terms 
of generators (extreme points and rays) or relations (linear or affine inequalities). In particular, a max-plus 
polyhedral cone can be defined by systems of the form "^x ^ Px" , whereas max-plus polyhedra can be 
defined by their affine analogues, "Ax + c ^ Bx + d" . Max-plus polyhedra have been used in particular 
in |Kat07[ ILGKLIO] to solve controllability and observability problems for discrete event systems, and they 
have been used in |AGG08] as a new domain in static analysis by abstract interpretation, allowing one to 
express disjunctive constraints. The question of solving "Ax ^ Bx" over (finite) relative integers has also 
been considered in |BNgC08bl |BNgC10| with motivations from SMT (SAT-modulo theory) solving. 

In many applications, it is necessary to pass from the description by inequalities "Ax ^ Bx" to the 
description by extreme generators. Although a reasonably efficient hypergraph based algorithm has been 
developed jAGGlOb] , its applicability is limited by the exponential blowup of the number of extreme gener- 
ators, in the worst case |AGKlla] . The alternative approach of tropical geometry |DS04| [Jos09| . in which a 
tropical polyhedron is represented by a classical polyhedral complex, is subject to a more severe exponential 
blowup (the number of cells of the complex exceeds the one of tropical extreme generators). However, in 
several applications, including the final control synthesis or observer synthesis step in |Kat07[ iLGKLlOj . one 
only needs to find a single solution or to decide that there is none. This subproblem, which is expected to 
be much simpler, is the object of Problems 11.11 and 11.21 the latter being the affine analogue of the former. 

The third problem, concerning linear dependence, is motivated by tropical geometry. In this setting, the 
tropical hyperplane |RGST05] determined by a vector m £ (R U {— oo})", non identically — oo, is defined as 
the set of points a; G (M U {— oo})" such that the maximum in the expression 

max(ui -I- Xi) 

ie[n] 

is attained at least twice, which may be written as "u ■ x — 0" , tropically. This arises naturally when 
considering amoebas, which are the images of algebraic varieties over a valued field by the map which takes 
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the valuation entrywise. We refer the reader to the survey by Itenberg, Mikhalkin and Shustin [IMS07| for 
more background. In particular, one may consider the field K := C{{t}} of formal Puiseux series over C in 
an indeterminate t, equipped with the non-archimedean valuation v which associates to a series the opposite 
of the smallest exponent of the monomials appearing in the series. Then, tropical hyperplanes can be seen 
to be amoebas of hyperplanes over K (this is a special case of a general result of Kapranov characterizing 
the non-archimedean amoebas of hypersurfaces, see jEKL06] ). Moreover, if the columns of a matrix with 
entries in K are linearly dependent over K, their images by the map which does the valuation entrywise can 
be seen to be linear dependent in the tropical sense, i.e., in the sense used in Problem 11.31 see |RG1ST05] . 
and so, deciding the linear dependence turns out to be a basic issue in tropical linear algebra. 

1.3. Discussion of the result. One interest of the transformation to mean payoff games that we describe 
here is of an algorithmic nature. Mean payoff games have been well studied since the work of Gurvich, 
Karzanov, and Khachiyan |GKK88j . who developed the first combinatorial algorithm to solve them. Since 
that time, the existence of a polynomial time algorithm has been an open question. Recall in this respect 
that decision problems concerning the value of mean payoff games are known to be in NP n CO-NP, see 
Condon |Con92| and Zwick and Paterson [ZP96| for more information. 

Pseudo-polynomial algorithms of value iteration type are known jZP96| , and other types algorithms have 
been developed jCTGG99[ IDG061 IBV071 IJPZ08) . These include pohcy iteration algorithms, which are 
experimentally fast on typical inputs, although Friedmann showed recently |Fri09j that a commonly used class 
of policy improvement rules leads to a worst case exponential execution time. The present transformations 
allow one to apply any mean payoff game algorithm to solve Problems I1.1H1.3I 

The problem of finding one solution of the system "Ax Bx" was previously considered without the 
connection with games by Butkovic and Zimmerman, who developed a combinatorial algorithm |BZ06j . 
The latter turns out to be only pseudo-polynomial, as shown by Bezem, Nieuwenhuis and Rodriguez- 
Carbonell |BNgG08a] . It is conceivable to extend the method of jBZ06j to solve the afhne case (Problem ll.2|) 
in pseudo-polynomial time. We are not aware of methods preexisting to the present work allowing one to 
solve Problem 11.31 in pseudo-polynomial time. 

If one requires the vector x to be finite. Problem 11.11 becomes simpler. In this special case, a reduc- 
tion which inspired the present one was made by Dhingra and Gaubert, who showed in jPGOGl § IV, C] 
(Corollary 13.41 below) that "Ax ^ Sx" has a finite solution if and only if all the initial states of an as- 
sociated mean payoff game are winning. A related result was established previously by Mohring, Skutella 
and Stork |MSS04| . who studied a scheduling problem with and/or precedence constraints, leading to a 
feasibility problem which is equivalent to finding a finite vector in a tropical polyhedron. They showed that 
the latter problem is polynomial time equivalent to deciding whether a mean payoff game has a winning 
state. In |MSS04| as well as in jDG06j and the present work, a mean payoff game is canonically associated 
(by a syntaxic construction) to the feasibility problem. Then, the approach of |MSS04j requires an addi- 
tional transformation, adding some auxiliary states, with special weights (determined by a value iteration 
argument). 

The present work relies on a different approach, based on non-linear Perron-Frobenius theory. This allows 
us to deal at the same time with infinite coordinates (i.e., tropically zero coordinates, this is an essential 
matter, both in applications and for theoretical reasons) and with infinite systems of inequalities, i.e., with 
tropical convex sets instead of tropical polyhedra, the former representing games with infinite action spaces 
on one side, including stochastic games. Even in the case of finite coordinates and finite systems, this 
approach leads to simpler results, since there is no need to transform the game as in |MSS04| . In particular, 
our first result shows that the system "Ax ^ Bx" has a tropically nonzero solution (possibly with infinite 
entries) if and only if the associated game has at least one winning initial state. In the case of Problem ll.il 
a key ingredient of the proof is a non-linear extension due to Nussbaum jNus86j of the Collatz-Wielandt 
characterization of the spectral radius of a matrix with nonnegative entries. Our approach to Problem 11.21 
relies on Kohlberg's theorem and is therefore in the more special setting of polyhedra. 

Thus, the results of the present paper allow one to apply game theory algorithms to solve problems of 
tropical algebra, but conversely, they also allow one to transfer results from tropical algebra to game theory. 
In particular, the set of elements of a max-plus (or min-plus) polyhedron coincides with the set of "bias" or 
"potential" vectors which are used classically to certify that the value of a mean payoff game is nonnegative 
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(or nonpositive) . Precise structural results on tropical polyhedra are available (including a description by 
extreme points and rays, see [AGKllbl lAGKlTa] and the references therein), and so, our results yield an 
explicit representation of the set of potentials. 

A related reduction, albeit of a different nature, was recently pointed out by Schewe |Sch09| . who showed 
that solving a mean payoff game reduces to a feasibility problem in linear programming but with exponentially 
large coefficients. The latter reduction appears to be related to the "dequantization" method in tropical 
geometry (see in particular the proof of Theorem 1 in [AGKlla] ). 

Finally, we note that after the submission of this paper, the present results and ideas have been applied in 
two further works: in |AGKllb] . it is shown that the tropical analogue of Farkas lemma, i.e., checking whether 
a tropical linear inequality can be logically deduced from a finite family of tropical linear inequalities, is also 
equivalent to a mean payoff game problem, whereas in |GKS10| , a reduction of tropical linear programming 
to parametric mean payoff games is presented. 

1.4. A theorem concerning the tropical rank. It is natural to look for characterizations of tropical 
linear independence in terms of determinants. The tropical analogue of the determinant of an n x n matrix 
B (with entries in R U {— cx)}) is the value of the optimal assignment problem 

(3) max ^ 

where the maximum is taken over all the permutations a of the set [n\. Following Dcvelin, Santos, and 
Sturmfcls |DSS05| , we say that a matrix B with entries in M is tropically singular if the above maximum is 
attained by at least two permutations. The same notion was first considered by Butkovic in |But941 IBut03| 
(tropically nonsingular matrices being qualified there of strong regular matrices). We shall indeed use the 
following extension of the above definition to the case of matrices B with entries in RU {— oo}: B is tropically 
singular if the above maximum is either attained by at least two permutations, or equal to — oo. As a corollary 
of our game reduction of Problem ll.3[ we obtain the following result (see Theorem I4.12p . 

Theorem 1.4. Let A be an m x n matrix with entries m M U {— oo}, with n. Then, the columns of A 
are tropically linearly independent if and only if A has a tropically non-singular n x n submatrix. 

This was first stated by Izhakian, and proved in the square case, in |Izh08j . The proof of the rectangular 
case given in the present paper, relying on mean payoff games, was announced in |AGG09| . Meanwhile, 
Izhakian and Rowen completed the proof in the rectangular case |IR09bj . using a different approach. In fact, 
as shown in jAGG09j . the "if" part of the result can be deduced from the max-plus Cramer theory |Plu90j 
(see also jRGSTOSl IAGG09j ). and the square case is related to a result of Gondran and Minoux |GM78j . 
It should also be noted that the special case of Theorem 11.41 in which the entries of the matrix A are finite 
can be derived alternatively from a result of Develin, Santos, and Sturmfcls jPSSOSi Theorem 5.5], showing 
that the Kapranov rank of a matrix is maximal if and only if its tropical rank is maximal. However, the 
present game approach (Theorem 14.91 below) yields a pseudo-polynomial algorithm and implies that the 
corresponding decision problem (checking whether the tropical rank is maximal) is in NP n CO-NP. 

What is surprising is that Theorem [T^l still holds in the rectangular case, since the analogue of this result 
in the "signed" case, in which tropical hyperplanes are replaced by sets of the form 

i7 = {x G (R U {— oo})" I max(u,; + .t,;) = max(iti + xi)} 

where / and J are disjoint non-empty subsets of [n], and the definition of tropical singularity is modified 
accordingly, turns out to be non valid in the rectangular case, as shown by the counter example of jAGG09] . 
This shows that some tropical linear algebra issues are better behaved when thinking of max-plus numbers 
as images by the valuation of complex Puiseux series rather than real ones. 

It is instructive to compare the different proofs of Thcorem ll.4l in the special case of matrices with finite 
entries: the one of |DSS05j relies on a mixed subdivision technique (the "Caylcy trick") combined with 
Sperner's coloring lemma; the one of Izhakian and Rowen jIR09b| . uses a reduction to the square case by 
a direct inductive argument; the "game" proof that we present here relies on some fixed point type results 
(Kohlberg's theorem or Nussbaum's CoUatz-Wiclandt property). There turns out to be a fourth proof which 
we include in the final section of this paper, in which the rectangular case is reduced to the square case by a 
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direct application of the tropical Helly theorem. Whereas the arguments in [PluQOl llzhOSj made in the case 
of square matrices can be interpreted in terms of network flows, it should be noted that a general result of 
Sturmfcls and Zclcvinsky [SZ93l showing that the Newton polytopc of the product of maximal minors of the 
general m x n matrix is not a transportation polytope, unless \m — ??| ^ 1, indicates that the direct network 
flow approach is unlikely to carry over to the rectangular case. 

Finally, let us point out that Kim and Rousch |KR05| showed that computing the tropical rank is an 
NP-hard problem, whereas our results suggest that the subproblcm of checking whether a matrix is of 
maximal tropical rank might be easier, because it belongs to NP n CO-NP. In addition, it can be solved in 
pseudo-polynomial time. More generally, our result implies that for a fixed fc, checking whether an m x n 
matrix has tropical rank at least n ~ k reduces to solving a polynomial number (namely (^) ) of mean payoff 
game problems (Corollary 14. 17p . Since checking whether the tropical rank is at most fc is a polynomial time 
problem fRemark l4.18[) . this suggests that the difficulty of the problem of computing the tropical rank may 
be concentrated in instances in which the tropical rank k is such that 1 <C A; min(m, n). 



2. Preliminary results 

2.1. Mean payoff games arising from tropical cones. We first recall some basic definitions concerning 
mean payoff games and associate a mean payoff game to a tropical cone. The state space of the game will 
turn out to be finite precisely when the cone is polyhedral. 

The max-plus semiring Mmax is the set of real numbers, completed by —oo, equipped with the addition 
(a, b) n> max(a, b) and the multiplication (a, b) ^ a + b. The name "tropical" will be used in the sequel as 
a synonym of "max-plus" . 

The reader is referred to CGQ04[ IDS04j for more background on max-plus or tropical convexity, and in 



particular to |CGQS05| IGKll] for the results on external representation. 

A tropical closed convex cone can be defined externally by a system of linear tropical inequalities of the 
form 

(4) Taax(Aij + xj) ^ max(i?.y + Xj), i € I 

jeln] jeln] 

Here, / is a possibly infinite set, recall that [n] := {!,..., n}, and Aij,Bij belong to Mmax- When the 
previous system consists of finitely many inequalities, i.e., when / = [m] for some integer m, we obtain a 
tropical polyhedral cone. Then, A and B will be thought of as to x n matrices with entries in Rmax- In the 
sequel, we shall denote by Mm,n{^max) the set of these matrices. 

We look for a non-trivial element of the cone, i.e., for a solution x = (xj) g K^ax of the above system, not 
identically —oo. From the algorithmic point of view, the polyhedral case is of primary interest. However, 
some of our results will turn out to hold as well in the case of infinite systems of inequalities, and their 
relation with non-linear Perron-Frobcnius theory will be more apparent in this wider setting. 

To study this satisfiability problem, we define the following zero-sum game, in which there are two players, 
"Max" and "Min" (the maximizer and the minimizer) . The state space consists of the disjoint union of the 
set / and the set [n]. The two players alternate their moves. When the current position is i e /, Player 
Max must choose the next state j G [n] in such a way that Bij is finite, and receives Bij from Player Min. 
If Player Max does not have any available action, i.e., if Bij = — oo holds for all j S [n], then Player Max 
pays an infinite amount to player Min and the game terminates. Similarly, when the current state is j G [n], 
Player Min must choose the next state i e / in such a way that Aij is finite, and receives Aij from Player 
Max. If Aij = —oo holds for all i G I, then, player Min pays an infinite amount to player Max and the game 
terminates. 

When / — [m], the game may be represented by a bipartite (di)graph, with two classes of nodes, [to] and 
[n]. The players move alternatively a token on the graph, following the arcs of the graph, which represent 
the possible moves. The weight of an arc represent the associated payment, see Example 12. 3l bclow. 

We shall often need the following assumptions, which require every player to have at least one available 
action in every state. 

Assumption 2.1. For all j G [n], there exists i G I such that Aij 7^—00. 

Assumption 2.2. For all i E I, there exists j G [n] such that Bij ^ —00. 
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Systems of the form ^ can always be transformed to enforce these assumptions. First, the trivial 
inequalities Xj ^ Xj , for j € [n] , can always be added to the original system, which makes sure that 
Assumption 12.11 holds. Then, if Bij = — oo holds for some i E I and for all j S [n], the right hand side of 
is identically — oo, and so every variable Xj such that Aij ^ — oo must be equal to — oo. By eliminating the 
inequality corresponding to i, wc obtain a new system in the remaining variables which is equivalent to the 
original one. We also eliminate all the inequalities in which the left-hand side is identically — oo (which are 
trivially satisfied). By performing this elimination step a finite number of times, we eventually arrive at an 
equivalent system involving a subset of variables, and satisfying Assumption 12.21 

Given an initial state i and a horizon (number of turns) N ^ we define vf to be the value of the corre- 
sponding finite horizon game for player Max. The existence of the value is immediate when the horizon is 
finite (but the value may be infinite if the set / is infinite, or if Assumption 12 . II or Assumption 12.21 does not 
hold). 

When both Assumptions 12.11 and 12.21 are fulfilled, we shall also consider the "mean payoff" game, in 
which the payoff of an infinite trajectory is defined as the average payment per turn received by player Max. 
Formally, we define this average payment as the limsup as the number N of turns goes to infinity of the 
payments received plus the opposite of the payments made by Player Max up to turn N divided by . (When 
Assumptions 12.11 or 12.21 do not hold, the payments must be counted up to the termination time if the latter 
occurs before time A.) The value of such games was shown to exist by Ehrcnfcucht and Myciclski |EM79j . 
assuming that the state space is finite. This can also be deduced from a theorem of Kohlberg (Theorem 
below), which implies in addition that the value vector of this game coincides with xif)- 

Example 2.3. The matrices 



A ■ 





— oo\ 






— oo\ 




— oo 




-3 




\— oo 


/ 




^-9 





arising from the system 



(5) 



yield the game 



2 + xi 
8 + xi 

X2 



^1+Xi 

^ max(— 3 - 
^ max(— 9 - 



Xi, -12 -I- X2) 
■ xi,5 + X2) 




in which the rows (states in which Max plays) are denoted by squares and the columns (states in which Min 
plays) are denoted by circles. For instance, when in circle state 1, Player Min may move the token to square 
state 1, receiving a payment of 2, and then. Player Max has no choice but putting the token on column node 
1, getting back a payment of 1 from Player Min. Hence, the mean payoff per turn for Player Max will be 
—2 + 1 = — 1 if the initial state is the circle node 1, and if Player Min chooses this strategy. However, if 
Player Min moves (greedily) the token to square node 2, receiving 8, Player Max may move the token to 
circle node 2, paying 12 to Player Min, but then. Player Min can be forced to follow the circuit between 
circle node 2 and square node 3, which ensures a mean payoff of 5 per turn unit to Player Max. Using these 
observations, one can check that the value of this mean payoff game is —1 if the initial state is circle node 1, 
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whereas the value is 5 if the initial state is circle node 2. We will explain below, in Example 13. Ill how this 
game can be solved analytically. 

2.2. Properties of order preserving and additively homogeneous maps. We now recall some basic 
properties of the dynamic programming operators arising from the previous games. 

We shall think of the collection of rewards as a kernel, to which we associate the max-plus 

linear operator S : (M U {-oo})" ^ (M U {-oo})^, 

{Bx)i := max(i?.y + Xj), ^ I . 

When / = [to], (-Bij)ig[m] will be thought of as a matrix in A4m,n(Mma,x), and Bx is the product in the 
tropical sense of the matrix B and the vector x. 

When Assumption 12.21 holds, this operator sends M" to M^. We define the operator A in the same way. 
The residuated operator from (R U {±oo})^ to (M U {±oo})" is defined by 

(6) (A«y), =inf(-A,,+y,) , 

with the convention (+oo) + (— oo) = +cxd. This operator sends (R U {— oo})^ to (R U {— oo})" whenever 
Assumption 12.11 holds, it sends to R" when in addition / is finite. 
The term residuated refers to the property 

(7) Ax X ^ A^y , 

where ^ is the partial order of (M U {±cxd})^ or (R U {±cxd})". Hence, System (U), which can be rewritten 
as Ax ^ Bx, is equivalent to a; ^ f{x) where / : (M U { — cxd})" — !> (M U {±oo})" is defined by 

fix) := A^Bx , 

denoting by concatenation the composition of operators. The map / sends (M U {— oo})" to itself whenever 
Assumption 12.11 holds. It sends R" to R" when in addition Assumption 12.21 holds and / is finite. 

The map / is the dynamic programming operator of the previous game, meaning that the vector := 
of values of the game in finite horizon can be computed recursively as follows 

More generally, setting := x for some x € R" determines the value function of a variant of the game, in 
which after the last step. Player Min pays to Player Max a final amount Xj depending on the final state j. 

We shall call min-max functions the self-maps of (M U {— oo})" that are of the form A^B, when A,B^ 
Mm,n{^nia,x)- This terminology goes back to Olsder j01s91| and Gunawardena [Gun94| . However, unlike in 
the latter reference, we do not require a min-max function to send R" to M". This generality will be needed 
in Section 1321 in which the games arising from the tropical linear independence problem will turn out to 
have occasionally empty sets of actions for Player Max. 

Any min-max function / from (R U {— oo})" to itself satisfies the following properties: 

(8a) / is order-preserving: x ^ y => f{x) ^ f{y) Va;,y G (R U {— oo})" , 

(8b) / is additively homogeneous: /(A + x) = A + f{x) VA G M U {-oo}, x G (M U {-oo})" , 

(8c) / is continuous. 

Here, RU{— oo} is equipped with the usual topology, defined for instance by the distance (x, y) i— > | exp(x) — 
exp(j/)|, and (R U {— oo})" is equipped with the product topology. 

When an order-preserving and additively homogeneous map / preserves M", it is easily seen to be sup- 
norm nonexpansive, meaning that 

\\f{^)~f{y)\\ < \\^-y\\, v.T,y gR" , 

where ||2;|| — maxjg[„] \xi\. A min-max function that preserves M" is piccewise affine (we can cover R" by 
finitely many polyhedra in such a way that the restriction of the function to each polyhedron is affine). 
Hence, the following general result applies in particular to such min-max functions. 
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Theorem 2.4 (Kohlberg jKohSOj ). A self-map o/M" that is nonexpansive in any norm and piecewise affine 
admits an invariant half-line, meaning that there exist two vectors v^rj £ R" such that 

(9) f{v + trj) = v + it + l)7^ 

for all scalars t large enough. 

In the study of mean payoff games, an important issue is to determine the hmit 

Xif) := lim /^(0)/7V= hm «^/7V , 

which gives the additive growth rate of the value of the finite horizon game as a function of the horizon N. 
Kohlberg's theorem implies that the limit xif) does exist. 

Corollary 2.5. Assume that every player has at least one available action in every state fAssumvtions [K7\ - 
\2.}3[) and that the state space is finite. Then, 

X(/) = V , 

where {v,rf) is an arbitrary invariant half-line of f . 

Proof. This result is well known in the operatorial approach of zero-sum games (see in particular |Ney03[ 
IRSOlaj ). we include the (simple) proof for the convenience of the reader. Since / is nonexpansive in the 
sup-norm, ||/^(x) — f^ {y)\\/N ^ ||a; — y\\/N tends to as tends to infinity. It follows that the existence 
and the value of the limit 

lim f^{x)/N 

N—^oo 

are independent of the choice of x G R". If v, i] is an invariant half-line, choosing x = v + torj, for some large 
enough to, we deduce that /^(.x) = x + Nrj, and so, limAr_i.oo f^ [x)/N = rj. □ 

Remark 2.6. If / is an order-preserving and additively homogeneous map preserving R", then, it was 
observed independently by Rubinov and Singer [RSOlbj and by Gunawardena and Sparrow (see |Gun03] ) 
that 



(10) fix) = inf fiy) + maxix, - y,) Va: G R" . 

yes." \ jeln] J 

This shows that / can be represented in the form f — A^B (the set / is equal to R"). This applies in 
particular to the dynamic programming operator of a stochastic zero-sum game 

(11) f,{x) = inf sup (rf + ^ Pf^x^), j G [n] , 

where [n] is the set of states at which the first player (Min) plays, Aj is the set of actions of this player, 
Bj is the set of actions of the second player (Max), the payment made by Min to Max if the actions 
a and b are selected in state j, and then, Pj^? is the probability to move to state k. The map / in (|lip is 
order preserving, additively homogeneous, and it preserves R" if for instance the payments r^^ are bounded. 
Then, it can be represented as in PU)) . See |FV97j for more background on stochastic games. 

2.3. The Collatz-Wielandt property. Some of the main results of this paper rely on a non-linear version 
of the Collatz-Wielandt characterization of the spectral radius which appears in Perron- Frobenius theory. 

Given any self-map / of (R U {— oo})" that is order-preserving, additively homogeneous, and continuous, 
we define the Collatz- Wielandt number of / to be 

(12) cw(/) = inf G R I 3w G R", /(w) ^^^JL + w} . 

A vector u ^ — cx) is a (non- linear) eigenvector of / for the eigenvalue AgRU{ — oo}if 

f{u) = \ + u . 

The (non-linear) spectral radius of / is defined as the supremum of its eigenvalues 

pif) = sup{A G R U {-oo} I 3iL G (R U {-oo})", u ^ -oo, f{u) = \ + u} , 



and is itself an eigenvalue of /. We shall also need the following "symmetrical" version of the Collatz-Wielandt 
number 

cw'(/) sup{A G R U {-00} | 3m e (M U {-00})", u ^ -00, f{u) ^ X + u} , 
as well as the following quantity. 

Proposition 2.7. // / is an order-preserving additively homogeneous self-map 0/ (R U {— cxd})", then, for 
all X £ R", the following limit exists and is independent of the choice of x: 

(13) xif) lim max/f (x)/7V . 

Proof. This is a variant of a result established in jVin97| IGK95| IGG04j when / preserves R". The proof 
relies on a simple subadditive argument, which we adapt here for completeness. Although / may not 
preserve R", it is still nonexpansive on R" in a generalized sense, meaning that for all x^y G R", — — 
y\\ + fix) ^ fiy) ^ \\x — y\\ + fix). The same is true if we replace / by its A^th iterate and so, 
-||a- - y\\/N + maxjg[„] f^ix)/N < max,g[„] f^iy)/N ^ \\x - y\\/N + max,g[„] (a;)/iV, which shows 
that the existence and the value of the limit in ([T3| are independent of the choice of a; £ R". Hence, 
we take 2: = in what follows. Since / is order-preserving and additively homogeneous, the sequence 
tjv '■— iiiaxjg[„] /j^(0) is easily seen to be subadditive, meaning that t^+M ^ ^tv + thi- It follows that the 
limit xif) = lim^v^oo /N exists. □ 

Of course, when xif) exists, we readily deduce from the definitions that 

xif) = maxxjif) ■ 

We next derive the following lemma from a theorem of Nussbaum |Nus86[ Theorem 3.1], dealing with 
non-linear maps on finite dimensional cones, which implies that cw(/) = When / preserves R", the 

fact that cw(/) — x(/), together with the final part of the statement of the lemma was proved in |GG041 
Theorem 8]. We refer the reader to |MPN02j for infinite dimensional generalizations. 

Lemma 2.8 (Collatz-Wielandt property, compare with |Nus86j and |GG04| ). Let / denote a map from 
(R U {—00})" to itself, that is order-preserving, additively homogeneous, and continuous. Then, 

(14) cw'(/) = pif) = cw(/) = xif) ■ 

Moreover, there is at least one coordinate j G [n] such that Xjif) •= liniAr^cx) fj^ix)/N exists and is equal 
to xif)- 

Proof. Nussbaum |Nus86[ Theorem 3.1] showed that if _F is a continuous self-map of a closed convex cone 
C in R", of nonempty interior, which preserves the order of the cone, and is positively homogeneous, then, 
the cone spectral radius of F, which is defined as 

max{A e R+ I 3u G C \ {0}, Fiu) = \u} , 

where R_|_ denotes the set of nonnegative real numbers, coincides with 

(15) inf{/i e IR+ I 3w e int(C), Fiw) ^w} . 

We associate to a map / the map Fix) = exp(/(loga;)), where log denotes the map from R" to (MU{— 00})" 
which does log entrywise (with log(O) = —00), and exp denotes the inverse of this map. Applying Nussbaum's 
theorem to the map F, we obtain pif) = cw(/). 

If w e R" and ^ G R satisfy fiw) ^ p + w, then, since / is order preserving and additively homogeneous, 
we get /^(w) ^ Np + w, for all N ^ 0. It follows that xif) = liniTv^oo niaxj£[„] fj^iw)/N ^ p. Taking the 
infimum over all p and w, we deduce that xif) ^ ew(/). 

If f{u) ^ X + u for some m S (R U {—00})", not identically —00, let w be a vector obtained by replacing 
every infinite entry of u by an arbitrary finite entry. Since u ^ w, we deduce that /^(w) ^ f^iu) ^ NX + u. 
Since maxjg[„] ^ —00, we get xif) = max^gj^j /j^(w)/A^ ^ ^im (A^A -I- maxjg[„] Uj)/A — X. It 

follows that A ^ xif)- Taking the supremum over all A and u, we deduce that cw'(/) ^ xif)- We also 
observe that by definition, pif) ^ cw'(/). Hence, we obtain pif) ^ cw'(/) ^ xif) ^ cw(/) ~ pif), from 
which we deduce the equality (fT4|) . 
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Finally, let us denote by cw^ (/) the supremum of the A such that there exists u G (RU {— cxd})" such that 
Uj is finite and f{u) ^ X + u. By definition cw{f) = maxjg[„] cwj(/), hence there exists j E [n] such that 
= cwj(/). Let us fix such an index j. For all A, u and w as above and such that Uj is finite, and for 
all X G R", we deduce from \\x - + /^(x) ^ /^(u;) ^ /^(u) ^ A^A + u that liminfAr_,oo ff {x)/N ^ 
A. Taking the supremum over A and m, it follows that liminfjv-).oo //'(a;)/-^ ^ cw'(/) = Since 
lim inf Ar_i.oo fj^{x)/N < limsupjY_^oQ fj^{x)/N ^ x(/)i '^e deduce that the limit Xjif) exists and is equal to 
Xif)- □ 

Remark 2.9. For all integers k, it follows from the definition of xif) that xif'') = ^xif)- Hence, the same 
is true for pif), cw'(/), and cw(/). 

Remark 2.10. When / preserves M", all the previous notions can be dualized. Indeed, it is known that 
an order preserving, additively homogeneous self-map / of M" admits a unique continuous extension to 
(R U {— cxd})", which we will still denote by /, see |BNS03| . Similarly, / admits a unique continuous 
extension to (M U {+00})", which we also denote by /. Then, the following dual quantities 

sup{pt G M I 3w G R", fiw) ^ fi + w} , 

inf{A G R U {+00} I 3u G (R U {+00})", u ^ +00, f{u) = X + u} , 
inf{A G R U {+00} I 3w G (R U {+00})", u ^ +00, /(w) A + w} , 
xif) := lim min /f (x)/iV, x G R", 

— N^coje[n] 

are readily seen to coincide (apply Lemma [Z!8l to the map x ^ — /(— x)). 

Remark 2.11. When / preserves R", we get xif) = cw(/) ^ maxig[„] (/^(w) — Wi) < 00 for any vector 
w G R". By duality (Remark l2.10p . xif) > —00. Since pif) = xif) ^ x(/)i this implies in particular that 
pif) is finite. 

2.4. Prom spectral theory to mean payoff games. Wc now interpret the previous results in terms of 
games. Whereas the "nonexpansive maps" approach of zero-sum games is well known |Ney03[ rRSOlaj . the 
significance in terms of games of the CoUatz-Wielandt property that we show in Proposition 12.121 does not 
seem to have been noted previously (it shows that the value is always well defined if one player is allowed to 
select the initial state, without the usual compactness and regularity assumptions). 

We call positional strategy of Player Max a map cr : / — >■ [n] such that Bia-{i) is finite for all i G / (so 
(7 is a rule, telling to Player Max to move to state aii) when the current state is i). Similarly, we call 
positional strategy of Player Min a map tt : [n] — >■ / such that ^7r(j)j is finite for all j G [n]. We denote by 
Smax and Smin the set of such strategies, respectively. Wc associate to the positional strategies a and n the 
"one-player" dynamic programming maps g" and h'^ , 

g^x) := inf (-Ay + + x^(j)) 

^T(^) ^^^^U)] + max(S^(j)fe + Xk) ■ 

k£[n\ 

Hence, (<7'^)j^(0) represents the minimal amount that Player Min will have to pay to Player Max in N steps, 
if the initial state is j, provided that Player Max applies the positional strategy a. A dual interpretation 
holds for (/i'')f (0). 

By construction of g'^ and h'^ , we have 

(16) fix) = sup g^ix) = inf h^ix) , Vx G R" , 

moreover, there is at least one a, depending on x, attaining the supremum (take aii) = k where k attains 
the maximum in maxkiBij + Xfe). Similarly, the infimum is attained by at least one tt, also depending on x, 
when the set / is finite. 

The following proposition, which is a consequence of the Collatz-Wielandt property, shows that xif) can 
be interpreted as the value of a variant of the mean payoff game in which the choice of the initial state 
belongs to Player Max. The lack of symmetry between both players is due to the fact that the set of states 
in which Max plays, i.e., the set /. can be infinite. 
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Proposition 2.12. Make Assumptions \2.S\ Then, Player Max can choose an initial node j £ [71], 
together with a positional strategy, so that he wins a mean payoff of at least xif)j whatever strategy Player 
Min chooses. Moreover, for all A > xif)' Player Min can choose a positional strategy so that she looses a 
mean payoff no greater than A for all initial nodes j G [n], whatever strategy Player Max chooses. 

Proof. Let us take arbitrary scalars A,/i such that A > /i > x{f). Since x(/) — cw(/), we can find a vector 
u 6 M" such that f{u) ^ /i + u. Since X > fi and 

(17) fj{u) = inf ( -Aij + m.ax{B^k + "fc) I 

iel \ fc6[n] / 

we can choose, for all j € [n], an index i = Tr{j) such that —Aij + maxfcg[„] (i^ife +Uk) is close enough to the 
above infinium, and then, 

h'"{u) A + u . 

Since h'^ is order preserving and additively homogeneous, an inequality of the form h'^[u) ^ A + u implies 
that {h'^)^{u) ^ NX + u. Moreover, since ||u|| +u, we deduce that {h'')^{0) ^ \\u\\ + and so, 

(/i")~(0) ^2||u||+iVA . 

Thus, if Player Min applies the positional strategy tt, and if the initial state is j G [n], she is guaranteed to 
loose no more than 

limsup(/i'')f (0)/7V ^ A , 

N 

whatever strategy Player Max selects. 

Take now u to be an eigenvector of / for the eigenvalue p{f), so that f{u) ~ p{f) + u. Since the maxima 
arising in the expressions (|17p are taken over finite, non-empty, sets. Player Max can choose a positional 
strategy a in such a way that 

Then, 

f''{u) = {g'^f{u)^Np{f)+u . 

Moreover, we can write ^ a + u, where a :— — maxfcg[„] Uk € K, and so {g"^)^ {0) ^ a + {g"')^{u) — 
a + Np{f) + u. It follows that 

hminf (5'^)f (0)/7V ^ p{f) if u, ^ ^ . 

Hence, the positional strategy a guarantees to Player Max the win of a mean payoff of at least if the 
initial state i is such that 7^ — 00. □ 

When the set of actions is finite on both sides, the previous analysis can be simplified. Actually, we have 
the following strong duality result. 

Theorem 2.13 (Coro. of |Koh80| . or |GG98a) l. Make Assumpt ions \2.1[ \2.'A and assume that I is finite 
(so, both players have finite actions sets). We have 

(18) xif) - nmxx(5") = minx(/i") , 

where the supremum and the infimum are taken over the positional strategies a £ S^ax om,d tt G '^■mva of 
players Max and Min, respectively. In particular. Player Max can choose a positional strategy, so that he 
wins a mean payoff of at least Xjif) */ initial node is j , whatever strategy Player Min chooses. Similarly, 
Player Min can choose a positional strategy, so that she looses a mean payoff no greater than Xjif) */ 
initial node is j , whatever strategy Player Max chooses. 

The first (and main) statement of this theorem appeared in |GG98aj , as a consequence of the termination of 
a policy iteration algorithm for mean payoff games, building on the ideas of [GTGG99] . A simpler argument 
which applies more generally to stochastic games with perfect information and finite state and action spaces 
appeared in [GG98bj . Actually, the result can be quickly derived from the existence of invariant half lines 
established by Kohlberg }Koh80| . We include the latter derivation here, since it shows how optimal strategies 
are effectively obtained from invariant half-lines. Note that Theorem 12.131 is related to, but different from, 
a strong duality theorem of Liggett and Lippman |LL69| . see Remark 12.141 below. 
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Proof. The map / n- xif) is order preserving. For all a, we have g'' ^ /, and so 

xigl ^ xif), Va . 

Let V, rj denote an invariant half-line of /, so that f{v + trj) = v + (t + l)rj for t large enough. We shall use 
the fact that the set of scalar affine functions t M- (p{t) a + tb, with a,b E R, is totally ordered for the 
pointwise ordering ^ in a neighborhood of oo, which is such that ipi if the inequality (/>i(i) ^ f2it) 

holds for all t large enough. Actually, this order is nothing but the lexicographic order on the coefficients, 
i.e., ipi(t) =01+ tbi ^ ^2it) ~ 0-2 + tb2 if ^2 > bi or 62 = ^1 and a2 ^ ai. In particular, the supremuni or 
the infimuni of a finite family of affine functions of t coincides with one of these affine functions of i, for t 
large enough. It follows that, for every i € I, we can choose <7{i) such that 

max(fiifc +Vk+ trjk) = B^^u) + v^u) + trj^u) 

holds for t large enough. Then, v + {t + 1)77 = f{v + trf) = g'^[v + trf) for t large enough, showing that ry 
is also an invariant half-line of g'^. It follows from CoroUarv 12.51 that xif) ~ xig")-, showing that a attains 
the maximum in (|18p . The argument for tt is similar. □ 

Remark 2.14. Theorem 12.131 should be compared with the strong duality theorem of Liggett and Lipp- 
man |LL69| . which concerns the value of the mean payoff game, in which the payment of an infinite run 
is defined as the limsup of the payment per turn as the number of turns tends to infinity, instead of x(/)j 
defined to be the limit of the value per turn of the finite horizon game. However, the existence of invariant 
half-lines (Kohlberg's theorem) implies that the limit and value operations commute, i.e., that xif) coin- 
cides with the value of the mean payoff game. In fact, the strategies a and tt constructed in the proof of 
Theorem l2.13l are easily seen to be optimal for the latter game. Hence, knowing Kohlberg's theorem, one can 
deduce Theorem 12. 13[ or rather, its generalization to the case of stochastic games with perfect information 
and finite state and action spaces, from the result of Liggett and Lippman |LL69j and vice versa. 

Remark 2.15. Theorem 1 2 . 1 31 provides a good characterization in the sense of Edmonds of the limit value 
per turn, xif)- The strategy a attaining the maximum in (jlSp provides a concise certificate allowing one 
to make sure that xif) is greater than or equal to a given vector. Indeed, g"^ is the dynamic programming 
operator of a one player problem, and so, xig"^) can be computed in polynomial time, by reduction to the 
maximal circuit mean problem [Kar78j . Similarly, the strategy tt attaining the minimum in psp provides a 
concise certificate allowing one to make sure that xif) is smaller than or equal to a given vector. This is 
illustrated in Example 13.121 below. 

3. The correspondence between tropical convexity and mean payoff games 

3.1. The reductions. We now come back to our original system of inequalities ([4]), written as Ax ^ Bx for 
brevity. We associate to this system the mean payoff game with dynamic programming operator / = A^B. 

Proposition 12.121 makes it legitimate to say that Player Max has a winning position whenever xif) ^ 
(i.e.. Player Max can choose the initial state in such a way that the mean payoff game has a nonnegative 
value). More generally, we shall say that the initial state i is winning whenever Xiif) does exist and is 
nonnegative. 

Our first result, which we deduce from the CoUatz-Wiclandt property fLemma l2.8p . does not require the 
number of inequalities to be finite. 

Theorem 3.1. Under Assumvtion \2.1l the system of linear tropical inequalities Ax ^ Bx has a solution 
X € Rmax non-identically —00 if and only if Player Max has a winning state in the mean payoff game with 
dynamic programming operator fix) = A^Bx. 

Proof. Due to the residuation property ([7]), we have that Ax ^ Bx if and only if a; ^ fi^)- 

Hence, if the system Ax ^ Bx has a solution x G MJ^^^^^ not identically — cx), then, cw'(/) ^ 0, and so, 
by Lemma [2.81 xif) ^ 0, showing that Player Max has a winning state. Conversely, if Player Max has a 
winning state, p{f) = xif) ^ 0, and so, there exists a vector u e (M U {—00})", not identically —00, such 
that f{u) = pif) + u^u. Then, Au ^ Bu. □ 

Actually, by using Kohlberg's invariant half-lines, instead of the CoUatz-Wielandt type property of 
Lemma l2.8|, we arrive at the following more precise result when the number of inequalities is finite. 
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Theorem 3.2. Let A ssumvtions [KT\ and \2.'A he satisfied, and suppose that the system Ax ^ Bx consists of 
finitely many inequalities (I = [m]). Consider the polyhedral cone P := {x € KmaxJ ^ Bx}, and define 
the support S of P to be the union of the supports of the elements of P: 

S := {j e [n]-. 3u e P,Uj ^ —00} . 

Then S is a support of an element of P, that is there exists u E P such that S = {j G [n\; uj =/= —00}. 
Moreover, S coincides with the set of initial states with a nonnegative value for the associated mean payoff 
game, that is: 

(19) ^={jeM;x,(/)^0} , 
where / : (M U {-00})" ^ (K U {-00})" is such that f{x) = A^Bx. 

Proof. The first assertion follows from the max-plus convexity of P, which is itself due to the max-plus 
linearity of the maps A and B. Indeed, for all j € S, let u^^'^ be an element of P such that u'^p ^ —00. Then 
V := supjgg it*-^^ is an element of P since Av = sup^gg Au^^^^ ^ sup^^^ Bu^^"^ = Bv, and vj —00 for all 
j e S. Hence, S C {j € [n]; Vj ^ —oo\ C S, which shows that S is the maximal support of an clement of P . 

In order to prove the second assertion, let us denote by T the right hand side of (|19p . Let u P. Due 
to the rcsiduation property ([7]), we deduce that u ^ f{u). It follows that u ^ f^{u), for all N. Hence, 
as in the proof of Lemma 12.81 considering a vector w obtained by replacing every infinite entry of u by an 
arbitrary finite entry, wc obtain that Xi{f) = 1™ ff{'w)/N ^ lim f^{u)lN ^ lim Ui/N = as soon 

N—yoo N^oo N—^oo 

&s Ui ^ —00. It follows that S C T. 

Conversely, let v, rj denote an invariant half-line of / (given by Theorem l2.4[) . so that f{v+trj) = v + {t+l)r] 
for t large enough, and xif) = V (by Corollary 12. 5p . Then, A{v + {t + 1)77) < B{v + trf), i.e. 

(20) max(Ay + Vj + [t + 1)77^) < max(Sy + Vj + tr]j) , i e [to] . 

je[n] j"e[n] 

Let u e MJJiax be such that Uj = Vj for all j & T, and Uj = —00 for all j ^ T. We shall show that, for t large 
enough, A{u + trj) ^ _B(u + tr]), or equivalently 

(21) •niax{Aij + Vj + trjj) ^ max.{Bij + vj + trjj), i £ [to] . 

Indeed, since rjj ^ when uj ^ —00, we deduce that A{u + trj) ^ A{u + {t + 1)?/) ^ A{v + (t + 1)77) for 
all t ^ 0. Moreover, by definition of T, we get that: 

(22) ma,x{Bij + Vj + trjj) + t^ Vt ^ and i e [to], 

where T'^ denotes the complement of T in [n], fi = maxj-g^c 7;-,- < and M is a real constant. Hence, 
using ([20|) . we obtain, for all t large enough: 

(23) [A{u + tf])], s$ max([B(M + tij)].,,M + tfi) . 

Again, using that rjj ^ when Uj ^ —00, wc deduce that An ^ A{u + trj) ^ An + tx{f) for all t ^ 0. 
When [Au]i = —00, this implies that [A{u + trj)]i = —00 for all f ^ 0, so that [A{u + t?/)]^ ^ [B{u + tri)]i. 
Otherwise, [Au]i ^ —00, then M + t/i < [Au]i ^ [A{u + tri)]i for t large enough, and by (j23p . we obtain that 
[A{u + tr,)], [B{u + tr])],. 

This shows that A{u + trj) ^ B{u + trj) holds for t large enough. Fixing such a t, we get that u + tijE P. 
Since v € R", the support of u + i7; is equal to T. We have proved that T C S, and so, T = S. □ 

Remark 3.3. Theorem 13.21 shows in particular that S is the maximal support of an element of P. 

The case of a full support in Theorem 13 . 2 1 leads to the following result, which was already pointed out by 
Dhingra and Gaubert in |DG06] . 

Corollary 3.4 ( [DG06| §IV, C]). Make Assumptions \2.1\ and \2.S\ and suppose that the system Ax ^ Bx 
consists of finitely many inequalities. Then, this system has a solution x G M" if and only if all the initial 
states of the associated game have a nonnegative value, i.e., 

xif) > . 
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Rather than a tropical polyhedral cone, we now consider a tropical polyhedron P, which is defined by 
systems of affine tropical inequalities of the form 

(24) max(max(Aij +Xj),Ci) ^ max(max(i?y +Xj),di), i G [m] 

je[ri] jeln] 

where the matrices A, B are as above and Ci, di G Rmax- 

As in the case of classical convexity, polyhedra can be represented by polyhedral cones, the latter being 
the projective analogues of the former affine objects. So, we construct new matrices A and B by completing 
the matrices A and B by an (n + l)th column, in such a way that Ai_n+i — Ci and -Bi.„+i = d^, for all i G [m]. 

We now define the map f{y) := By for all y G (R U {-cx)})"+i. 

Theorem 3.5. The tropical polyhedron P defined by (j24p is nonempty if and only if the value of the mean 
payoff game with dynamic programming operator f , starting from the initial state n + is nonnegative, i.e., 

Xn+lU) ^0. □ 

Proof. For any x G Rmaxj we define the vector x by completing the vector x by an (n + l)th coordinate equal 
to 0. Then, 

X ^ P ^ X eC := {y \ Ay ^ By} . 

Moreover, if y G C is such that yn+i ^ — oo, then the vector x G R-max such that Xi = yi — yn+i for i G [n] 
belongs to P. Hence, the polyhedron P is nonempty if and only if there exists y in the polyhedral cone C 
such that y„+i ^ — cxd. 

We may assume, perhaps after some transformations, that the matrices A, B satisfy Assumptions 12.11 
and 12.21 Then, applying Theorem 13.21 to A, B and C, we readily obtain the assertion of the theorem. □ 



Note that this theorem shows that the emptyness problem for (affine) tropical polyhedra reduces to 
checking whether a mean payoff game has a specific winning state. 
The next theorem yields the converse reduction. 

Theorem 3.6. Let f = A^B, with A,B G A^m.n(Rmax); denote the dynamic programming operator of a 
mean payoff game (thus Assumptions and \2.2\ are satisfied). Then, for every r G [n] and A G R, the 
inequality Xrif) ^ A holds if and only if the following tropical polyhedron is non-empty: 

Pr := {y G R;4ax I ^ + max(max(Aij + y^), A^r) ^ max(max(_Bij + yj),B,r), Vi G [m]} , 
where J := [n] \ {r}. 

Proof. Note first that xif) = A + x{9)i where g is the dynamic map of the mean payoff game obtained by 
adding the constant A to every entry of A. Thus, it suffices to consider the case in which A = 0. Then, 
Theorem 13.21 shows that Xr (.<?) if and only if the polyhedron 

P {x G RJiax I niax(Ay + xj) max(By + x^)} 

admits a solution x such that Xr ^ — oo. Setting yj = Xj ~ Xr for j G J = \ {r}, we get that y G Pr, and 
vice versa. □ 

Corollary 3.7. Each of the following problems: 

(1) Is an (affine) tropical polyhedron empty? 

(2) Is a prescribed initial state in a mean payoff game winning? 

can be transformed in linear time to the other one. 



Remark 3.8. We could use Theorem 13.61 together with a dichotomy argument to compute the value of a 
mean payoff game using an oracle solving the emptyness problem for tropical polyhedra. 

In some circumstances, the matrices A, B may have integer coefficients, and we may be only interested in 
the elements of a tropical polyhedron with integer (or — oo) coordinates. The following result shows that in 
this case, the feasibility problems over the integers and over the reals arc equivalent. 



Proposition 3.9. Let A, B be two m x n matrices with entries in ZU {— oo}. Then, if the polyhedron 
P:^{xe R^^^ I max(^„- + Xj) max(S„- + Xj), Vi e [m]} 

contains a vector y with entries m M U {— oo}, it also contains a vector z with entries in Z U {—00} and 
precisely the same set of indices (positions) of finite coordinates. 

Proof. Without loss of generality, we assume that all the coordinates of y are finite (otherwise, it suffices 
to consider the pre-iniage of the polyhedron P by the injective map x € Kmax x € K^ax where J is set 
of indices of finite entries of y and [x] is obtained by completing x by —00 entries: [x]j = Xj for j € J 
and [x]j = —00 for j ^ J). Then, we must show that P contains a vector 2 S Z". The condition that 
y £ P may be written as y ^ f{y) where / := A^B. Moreover, since y £ M" is such that y ^ f{y), it 
suffices to add or eliminate inequalities in the definition of P in order to obtain matrices A and B satisfying 
Assumptions [2?11 and [2?2] Hence, the map / can be assumed to preserve M". Then, it is nonexpansive in 
the sup-norm, and so does the map g{x) := min(/(a;), x). Since y ^ /(y), we have g{y) = y. Consider 
now the orbit z'^ — (7*^(0), recalling that 5'^ denotes the fcth iterate of g. Since g is nonexpansive, we have 
11^*^ — y\\ = llff'^CO) — 9''{y)\\ ^ \\y\\, which shows that z*^ is bounded as k tends to infinity. By definition of g, 
we have z^ ^ z^ ^ ■ ■ ■ . Hence the sequence z'^ is converging to some element of M". Since the coefficients 
Aij and Bij are integers (or —00), the map g preserves Z", and so, the sequence z*^ must be ultimately 
stationary, meaning that z*"'"*"^ = g{z'^) = z'^ for some k. It follows that z'^ ^ f{z^), and so, P contains the 
vector z^ which has (finite) integer coordinates. □ 

Since every affine polyhedron in dimension n can be represented by a polyhedral cone in dimension n + 1 
by the trick which we used in the proof of Theorem l3.5l the following is obtained as an immediate corollary. 

Corollary 3.10. Let A, B be two mxn matrices with entries m ZU {—00}, and let c,d be two vectors of 
dimension n with entries m Z U {— 00}. Then, if the polyhedron 

P :— {x € IR^ax I max(max(^ij + Xj), Ci) ^ max(niax(i3ij + Xj), di), Vi £ [m]} 

j"G[n] ie[n] 

contains a vector y with entries m K U {—00}, it also contains a vector z with entries in Z U {—00} and 
precisely the same set of indices of finite coordinates. □ 

Example 3.11. Let us illustrate Theorems 13. i I and 13.21 on the base of Example 12.31 An invariant half- line 
of / is given by 

V = (0, 0)^, and ri = (-i, 5)^ 

The vector 

v' = (-CX), O)"^ 

is a solution of jl]) . The fact that 771 = — 1 < implies that there is no finite solution. (Recall that invariant 
half-lines can be obtained from several mean payoff game algorithms, including [DG06] .) 

Example 3.12. Wc now give a geometrical illustration of Theorem 13.21 Let a denote a real parameter, and 



consider the three inequalities 

xi ^ a + max(a;2 — 2, 0:3 — f) (-^1) 

-2 + X2 ^ a + max(a:;i , — 1) (-H'2) 

max(x2 — 2,X3 — a) ^ xi + 2 (Hs) 



the tropical half-spaces (Hi) and their intersection being shown in Figure[2l for a e {1, —1/2, —3/2}. Here, 
each finite vector a; € R U {— oo}'^ is represented by its intersection with the hyperplane xi + X2 + X3, = 0, 
thus, vectors with —00 coordinates correspond to points at infinity in this picture. 
The associated game is shown in Figure [TJ When a = 1, an invariant half- line of / is 

V = (-1.5, 0.5, 0)^, ?7 = (1.5, 1.5, 1.5) . 

Choosing a positional strategy of Max is equivalent to selecting only one output arc in each square state. 
Such a strategy a is shown in Figure [1] (middle) . The value of the one player game in which a is fixed can 
be easily seen to be (2a + l)/2. This corresponds to the paymcnt-per-turn ratio of the circuit shown in bold 
(recall that the weights of the arcs from a circle to a square nodes must be counted negatively, whereas the 
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weights of arcs from square to circle nodes count positively; moreover, each arc counts for a half-turn). There 
is in fact another circuit, from circle node 3 to square node 2, and back, which has a payment-per-turn ratio 
of a + 1; since a + 1 > (2a + l)/2, the latter never arises in an optimal rcponsc of Player Min to the strategy 
(T. By Theorem 12.131 we have Xiif) ^ Xi(5'^) = (2a + l)/2 for all i, which by Theorem 13.21 implies that 
the intersection of the three half-spaces Hi D H2 H3 is not reduced to the identically —00 vector for all 
a ^ —1/2, which can be checked geometrically in Figured 

Similarly, choosing a positional strategy of Min is equivalent to selecting only one output arc in each circle 
state. Such a strategy tt is shown in Figured] (right). Whenever Min chooses this strategy, Max has no 
better choice than going to the same circuit in bold, showing that Xiif) ^ Xii^^) = (2a + l)/2 for all i. 
Thus, Xiif) = (2a + l)/2 for all i G [3]. In particular, x{f)i = Xi{h^) < for a < —1/2, and so, the strategy 
TT certifies that the intersection Hi n H2 H H3 is reduced to the identically —00 vector in this case. 




Figure 1. Game associated with the family of tropical half-spaces Hi, 1 ^ i ^ 3 in Ex- 
ample [3321 (left). Positional strategies of Max (middle) and Min (right), both with a mean 
payoff of (2a -I- l)/2, corresponding to the circuit shown in bold (the strategies avoid the 
dotted arcs). 




Figure 2. Example 13.121 (cont.): a = —3/2, a relative neighborhood of the boundary of 
each half-space is shown in gray, the intersection does not contain any finite vector (left); 
a = —1/2, the intersection is a tropical convex cone with two generators, represented by a 
half- line in bold (middle) ; a = 1 , the intersection of half-spaces HiC] H^C] H3 is the region 
in gray (right). 
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Remark 3.13. Theorem 13.21 shows that an initial circle state j G [n] is winning if and only if there is a 
vector X in the associated tropical polyhedral cone 



P := {x e (M U {-oo})" I Ax =^ Bx} , 



such that Xj ^ — oo. As noted in Remark 12.101 all the present constructions admit dual versions. In 
particular, when the action states are finite on both sides, so that / = [m], it can be checked that a square 
state i G [m] is winning for Player Min if and only if there is a vector y, in the dual tropical polyhedral cone 



such that yi ^ +oo [P' is a convex cone in the min- plus sense). To see this, it suffices to consider the one 
day operator f{y) = BA^y, and note that BA^y ^ y holds if and only if A^y ^ B'^y. 

Remark 3.14. We note that solving the system of tropical inequalities Ax ^ Bx or the system of tropical 
equalities Ax = Bx are computationally equivalent problems: each of the two problems trivially reduces to 
the other one. Indeed, Ax ^ Bx holds if and only if Cx = Bx, where C denotes the matrix obtained by 
taking the pointwise maximum of A and B. Conversely, Ax = Bx holds if and only if we have both Ax ^ Bx 
and Bx ^ Ax, which is again a system of the form but with 2m inequalities instead of m. 

Remark 3.15. In jAMOQj . Atserias and Maneva show that a mean payoff game has a nonnegative mean 
payoff vector if and only if an associated "max-atom problem" |BNgC08b] has a finite integer solution. The 
latter is equivalent to finding a vector u G Z" such that z ^ f{z). This is analogous to the result of |DG06| 
fCorollarv 13.41 here), the condition that u G M" being replaced by m G Z". This could also be obtained as 
a consequence of the present Corollary 13.41 by using Proposition 13.91 showing that solvability over the reals 
and over the integers are equivalent if the data are integer. 

3.2. A power algorithm to check whether Player Max has a winning state. As it is mentioned in the 
introduction, the problem of computing the value of a mean payoff game with finite state and action spaces 
is a well studied one, for which several algorithms with a fast experimental average case execution time are 
known |GKK881 [CTGG991 [GGMa] . ahhough the complexity of the problem is still unsettled jJPZOSj . Zwick 
and Paterson |ZP961 Theorem 2.3] showed that the value iteration allows one to determine the value (the 
vector xif)) of ^ mean payoff game in pseudo-polynomial time, assuming that the instantaneous payments, 
i.e., here, the finite entries Aij and Bij, arc integers. 

However, to solve Problems 11.11 or 11.31 we only need to decide whether there is one winning state, and 
then, the value iteration algorithm can be refined by exploiting the Collatz-Wielandt property, which leads 
to the algorithm that we next describe. 

We assume here that / = [m], that Assumptions I2.ll and 12.21 hold, take / = A^B, and set 



Lemma 3.16. We have x(ff) 5^ if and only if xif) ^ 0- 

Proof. Since g < /, we have {x) ^ f^{x) for aU N and for aU x, and so, xid) =^ x(/)- Hence, xig) ^ 
implies xif) ^ 0- To show the converse, let us take a vector u G (M U {— c«})", not identically — oo, such 
that f{u) = p{f)+u. li xif) ^ Oi then, p{f) = xif) ^ Oj and so, g{u) = mm{p{f) + u,u) = u, which implies 



Observe that if xid) < 0, we must have xig) ^ —l/in + m). Indeed, since the mean payoff game admits 
optimal positional strategies, pig) must be equal to the weight-to-length ratio of an elementary circuit in 
the graph of the game, and such a circuit must have a length at most n -\- m and a negative integer weight. 

Define now the sequence 



P' := {ye{RU {+oo})" | A^y ^ B^y} 



min(/(x),a;) . 



that xig) = pig) > 0. 



□ 



(25) 



X 



,k+l 




We shall make several observations. 



(1) If Xj < for aU j G [n], then, xig) < 0. 

Indeed, we have cw{g'') ^ maxjg[„](x^ 
we deduce that xig) = cw{g) < 0. 



x^) < 0, and since, by Remark 12.91 cw{g'^) = kcw{g), 
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(2) If xig) < 0, then Xj<0 holds for all j S [n] as soon a.s k ^ K := 2{n + m)'^AI + 1, where M is the 
maximal modulus of the integers appearing as the finite coefficients of A, B. 

Indeed, Theorem 2.2 of [ZP96 shows that x'^ ^ kxi{g) + 2(n + m)M . Hence, if x{g) < 0, we get 
^ —k/{n + m) + 2{n + m)M, and the result follows. 

(3) If 2;'°+^ = x'^, then, we readily conclude that xis) = Pid) ^ Oi since .t'^ e K." (by the assumptions on 
A and S, / preserves M"). 

(4) Let Jfe := {j G [n] | a;^'"*^^ < x^}, assume that Jk is non-empty and different from [n], and define y*^ 

by 

fe jx'^ if j € W \ Jk 

y j ^ \ 

I — cxD otherwise 

By construction, is a non-identically — oo vector, and it is a candidate to be a fixed point of g. If 
g{y'') = y*^, we must have x(g) ^ 0. 

The previous observations justify the following power type algorithm, which consists in computing the se- 
quence x^ . If, for some fc, Condition ([T|) is satisfied, we stop the algorithm, x^ being a certificate that 
x{g) < 0- Similarly, if for some fc. Condition or Condition ^ is satisfied, we stop the algorithm, x^ or 
y^ being a certificate that x(<?) ^ 0. Finally, if step k ^ K is reached, we must have x(ff) ^ and stop the 
algorithm. 

This algorithm requires at most K iterations, and since one iteration takes a linear time, the algorithm 
is pseudo-polynomial. However, the practical interest of testing Conditions or in addition to Con- 
dition (HI is that they can frequently be met before the termination time K is reached. A more precise 
complexity analysis is beyond the scope of this paper. 

Remark 3.17. The previous power algorithm can be initialized with an arbitrary vector x'^ G M". This 
reduces to the former case if we replace f{x) by .t" + f{x — x^). Then, the payments and so the constant M 
must be modified accordingly, and the stopping condition ([1]) becomes a;^ < cc^ for all j G [n] . 



4. Mean payoff games expressing tropical linear independence 

4.1. Extension of the tropical semiring and linear independence. In tropical algebra, the set of 
"zeros" of an expression is generally defined by the requirement that the maximum of the terms arising 
in this expression is attained at least twice. The notation "* = 0" is often used in this sense informally. 
This notation can in fact be given a formal meaning, by using an extension of the tropical semiring, which 
was introduced by Izhakian jlzhOS] . The latter may be thought of as the "complex" analogue of the "real" 
(signed) extension of the tropical semiring introduced by M. Plus |Plu90| . In a nutshell, the "numbers" 
of the extension of Izhakian carry an information reminding whether the maximum of an expression is 
attained twice, whereas the "numbers" of the extension of M. Plus carry a sign information, reminding 
whether the maximum of a signed formal expression is attained by a positive term, by a negative one, 
or both. The approach of ^IzhOS] has been pursued in several works of Izhakian and Rowen like |IR09aj . 
whereas the authors have studied in [AGGOQj semirings with an abstract involution, in order to unify both 
approaches. Such extensions provide a convenient notation, and, as shown in |Plu901 |AGG09| . they allow 
one to perform elimination arguments, as in the Gauss algorithm, while staying at the tropical level, and to 
obtain automatically polynomial identities over semirings. 

Although our primary interest is in the basic max-plus case, we shall establish our results in the framework 
of the extended tropical semiring, which leads to slightly more general results. The reader interested only 
by the max-plus case may skip the present section, and specialize the further sections by assuming that the 
matrices have entries in the max-plus semiring rather than in its extension. 

The presentation which follows is a simplified version of [AGG09j . 

Definition 4.1. Let N2 be the semiring which is the quotient of the semiring N of nonnegative integers by 
the equivalence relation which identifies all numbers greater than or equal to 2, and denote N2 = N2 \ {0} 
and M^ax = l^max \ {^00}. The extended tropical semiring is the subset of N2 x Mmax^ 



Te (N; xR^^aJU {(0,-00)} 
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endowed with the addition 

r (a + a',6) if b = b' 
(a, 6) ©(a', 6') = <^ (a, 6) if b > b' 

[ {a',b') if b<b' 

and the multiphcation 

{a,b)(D{a',b') = {a-a',b + b'). 

The extended tropical semiring as defined above is a semiring with zero (D (0, — oo) and unit 1 := (1, 0) 
and it is isomorphic to the extended tropical semiring defined in jlzh08| (see [AGG09| ). 

The semiring Tc is not idempotent, but is ordered naturally by the relation: x ^ y if there exists z G Te 
such that X (3 z = y. The map tt : Te — >■ Mmax, (a, 6) 7r(a, 6) := 6 is a surjective morphism, thus it is 
order preserving. However the natural injection from M,nax to Tc, which sends b G Kmax to (1, b) and — oo to 
(0, — oo) is not a morphism. Nevertheless, it is a multiplicative morphism, it is order preserving and denoting 
by 6^ the image of 6 e M,nax by this injection, the following holds for all x,y £ T^: 

(26) x'^ V y"" s^{x(S y^ s^x"" ey"" , 

where a V 6 denotes the least upper bound of two elements a, 6 G To. 

The following notations are defined in jAGG09] for any semiring with symmetry. We avoid here the use 
of the minus sign. 

Definition 4.2. For any a G To, we set a° := a © a, and we denote 

T° {a°; a G To}, T,^ := (To \ T°) U {(0, -oo)} , 
and we define on To the balance relation V by 

aVb ^ a©5GT° . 

The balance relation is reficxivc, symmetric but not transitive. Denoting b° :— (6^)° for b G Mmax, we get 
that 

To° = {b°; b G ]R„,ax}, To^ = {6^; b G ]R„,ax} ■ 
We shall say that an element of To is of type real if it belongs to To and of type ghost if it belongs to T" 
(thus, the zero element of the semiring has both types). An element a of To is determined by its projection 
7r(a) G Mniax and by its type. The elements of To \ {©} are precisely the invertible elements of To. 

This algebraic structure encodes whether the maximum in an expression is attained once or at least twice. 
The elements b^ with b G IR*nax correspond to expressions the maximum of which is finite and is attained 
only once, the elements b° with b G IR^ax correspond to expressions the maximum of which is finite and is 
attained at least twice, the element (D G T" n To corresponds to expressions the maximum of which is — oo. 
For instance, the following computations are valid 

2^0 2'' = 2°, 2''©3'^=3'', 2'' ©3° = 3°. 

The previous notations will be extended to vectors, entrywise. For instance, if x,y G T", we shall write 
a; V y if Xj V yj for all j G [n] . 

Definition 4.3. If A is a matrix in A^m.„(Te), we shall say that the columns of A arc tropically linearly 
dependent if there exists a vector x G (Tp )", different from the zero vector (D, such that 

AxViD . 

When A is the image of some matrix B G A^m.n(IIimax) by the canonical injection, meaning that Aij = B^j, 
setting a; = for some y G Kmax; we easily check that Ax V (D holds if and only if the maximum in each of 
the expressions 

max(i?jj +yj) , i € [m] , 

is attained at least twice, or equal to — oo, which is the natural notion of tropical linear dependence over 
IRmax given in the introduction (statement of Problem II .31) . 

Thus, all the statements that follow which concern tropical linear independence over To yield in particular 
corresponding statements for tropical linear independence over Mmax- The interest of the notation Ax V (D is 
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its similarity with the classical notation Ax = (the columns of a matrix over a ring are dependent if some 
nontrivial linear combination of the columns vanishes). 

Tropical linear independence turns out to be controlled by permanents. 

Definition 4.4. Let A — (Aij) e A^„_„(To). The permanent per A of the matrix A is the element of Tg 
defined by 

where &„ denotes the set of all permutations of the set [n]. 

If Aij — B^A for some Bij G Mmax, then, the projection onto Mmax of the permanent of A^ 



7r(perA) = max(Si^(i) H hS„^(„)) , 



is the value of the optimal assignment problem with weights Bij . The type of per A is real if there is only 
one optimal permutation, or if the value of the previous maximum is — oo, and it is ghost if there are at least 
two optimal permutations. Moreover, per A is invertible if and only if B is tropically nonsingular as defined 
in the introduction (see Section [Ll)) . This suggests the following definition. 

Definition 4.5. We shall say that the matrix A G A4n,„(To) is tropically nonsingular if per A is invertible 
in Tc. 

In the sequel, we shall establish results for matrices with entries in the extended tropical semiring To. 
Then, we shall derive the analogous results for matrices with entries in the tropical semiring as immediate 
corollaries. 

4.2. Reducing tropical linear independence to mean payoff games. We denote by A an to x ?i matrix 
with entries in To, and we shall assume: 

Assumption 4.6. The matrix A has no column consisting only of elements o/T°. 

This assumption is not restrictive, for if A had such a column, the columns of A were tropically linearly 
dependent, and when to ^ n, all n x n submatrices were tropically singular, so that the equivalence which we 
are going to prove in Theorem 14.121 for matrices satisfying Assumption 14.61 is trivially true in this situation. 

We set 

(27a) E = {{z,jy,A,eT^,\m- 

Thanks to Assumption 14. 6[ for all j e [n], there is at least one index i G [jti] such that {i,j) G E. 
We define the min-max hmction / : (M U {— oo})" — > (M U {— oo})" given by 

(27b) fj{x) ^ rain {-Bi., + max {B^k + x^)) , 

{^,0)&E ke[n], k^] 

where 

(27c) B,j := t:A,j G R,„ax • 

This function can be interpreted as the dynamic programming operator of the following combinatorial game, 
which is played on a bipartite digraph with n column nodes and m row nodes. Being in a column node j, 
player Min chooses a row node i such that (i,j) G and moves to node i receiving Bi^. Then, player Max 
must move to some column node k which is different from the previously visited column node j, and he 
receives B^fc. Thus, when all entries of A are in (that is A = i?^), player Min is advantaged, because she 
can always come back to the state from which player Max just came, ensuring her a loss. In that case, it 
follows that x(/) < 0. 

Such a game may be put in the form studied in Section [2. H in which the available actions only depend on 
the current state, by adding the previously visited node to the state. Formally, the map / may be written 

as j{x) = C^Dx, where C, D are (tom) x n matrices, with 

By \ik = i and (i, j) G B ^ \b,u if 7^ J 



(28) Cu j\ I; — \ Du j-i I; — 

— oo otherwise, — oo otherwise. 
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Due to Assumption 14.61 no column of C is identically —oo, hence / sends (M U {— oo})" to itself. However, 
some rows of D may be identically — oo, as soon as A has a row with at most one clement not equal to 
— oo. In that case the map / may not send M" to itself. But one can apply Proposition 12. 7[ Lemma and 
Theorem 13.11 

Theorem 4.7. Let A he an m y. n matrix with entries in To, satisfying Assumption \4.()\ Let E, B and f be 
defined as in (|27|) . Then a vector u G K^ax such that 

Au^ V(D 

if and only if u /(^)- 

Proof, li Any JJ (D, then, there exists some index i such that {A u'^i — Aij 0wj is invertible in To, which 
implies that there exists some index j such that Ay is invertible and i^Aij + Uj > maxj,g[„]_ k-^jij^-^ik + w^). 
With the above definitions of Li and iJ, it follows that (i, j) G L^ and Uj > — + maxj,g[„]_ k^jiBik + ttfe). 
We deduce that Uj > miujgj^]^ ^ij)^E{~Bij + max;;g[„]^ k^j{Bik + Uk)) = fj{u). The previous deductions 
turn out to be equivalences, and so, Au^ y (D iff there exists some index j such that Uj > fj (w). By negating 
both conditions, this shows the theorem. □ 

We get as an immediate consequence. 

Corollary 4.8. Let B be an m x n matrix with entries in Mmax which has no column consisting only of 
elements — oo. Denote E ~ Bij ^ — oo}, and define f by (j27bp . Let u be a vector in (M U { — oo})", 

not identically — oo. Then, the following conditions are equivalent: 

(1) u ^ f{u); 

(2) The equation "Bu = " holds in the tropical sense, meaning that in every expression 

Taax.(Bij + Uj), i G [m] 

the maximum is attained at least twice or is equal to — oo; 

(3) All the rows of the matrix B are contained in the tropical hyperplane consisting of those vectors 
X € ^max such that the maximum in maxjg[„](a;j + Uj) is attained at least twice or is equal to 

"OO. □ 

The following theorem provides an expression of tropical linear independence in terms of mean payoff 
games. 

Theorem 4.9. Let B be an m x n matrix with entries in Mmax which has no column consisting only of 
elements — oo. Denote E — {{i,j); Bij ^ — oo}, and define f by (j27b[) . The following assertions are 
equivalent. 

(1) The columns of the matrix B are tropically independent; 

(2) Player Max has no winning state in the mean payoff game with dynamic programming operator /, 
i.e., xif) < 0; 

(3) there exists a vector w £ M" and a scalar A < such that 

f{w) i^X + w ; 

(4) there is no vector u G (M U {— oo})", without finite entries, such that u ^ f{u) . 

In fact, wc shall prove the following more general result, in the setting of the extended tropical semiring. 

Theorem 4.10. Let A be an m x n matrix with entries in Tc, satisfying Assumption \4.6\ Let E, B and f 
be defined as in (|27p . Then, the columns of the matrix A are tropically linearly independent if and only if 
the map f satisfies one of the three equivalent conditions (|2I3I4I) of Theorem \4-9\ 

Proof. By Definition 14.31 and Theorem 14. 7[ the columns of A arc tropically dependent if and only if there 
exists a vector u G (M U {— oo})" non-identically — oo such that u ^ f{u). This shows that Property ^ 
is equivalent to the tropical linear independence of the columns of A. By definition, (jS]) is equivalent to 
cw(/) < and (j4|) is equivalent to cw'(/) ^ 0. From Assumption 14.61 the matrix C of ([28|l has no column 
identically equal to — oo, hence the equivalence between ([2]), ([3]) and (|4|) follows from Lemma \2M □ 
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4.3. Characterizations of the tropical rank. We shall now derive Theorem 11.41 and related results 
concerning rank of matrices in the more general framework of matrices with entries in Tg. We shall need 
the following tropical Cramer theorem proved in |AGG09] which is analogous to the Cramer theorem of 
M. Plus |Plu90] ■ the symmetrized max-plus semiring being now replaced by the extended tropical semiring. 
This is a refinement of a result concerning the tropical Cramer formula stated by Richter-Gebert, Sturmfels, 
and Theobald in |RGST05| . which deals with a generic case. 

Theorem 4.11 QAGGOQi Theorem 6.6]). Let A e 7W„(Te) and b e T^, then 

(1) Every real solution x of the linear system 

AxVb 

satisfies the relation {per A)x'V A'^'^'b. 

(2) Moreover, if the vector A'^'^^b is real and per^ is invertible in Tc, then x := per 

^-i^adj^ zs the 

unique real solution of Ax^b. 
Here A^'^' is defined by {A^'^^)ji — peiA{i\j), where A{i\j) is the matrix obtained from A by deleting j-th 
column and i-th row. 

As a consequence of the game formulation and of the latter theorem, we obtain the following result. 

Theorem 4.12. Let A G Mm.nC^c) with m ^ n. Then, the columns of A are tropically linearly independent 
if and only if A has an n x n submatrix that is tropically nonsingular. 

Izhakian and Rowen obtained independently the same result in a recent work |IR09b| . by a different 
method. 

Proof. The "if" part of the assertion was already shown in jAGG09| Lemma 8.1] using Theorem 14.111 We 
reproduce the proof for completeness. Assume that A has a tropically nonsingular submatrix of maximal 
size, denote it by F, and assume by contradiction that Ax V (D for some real non-zero vector x. Then, Fx V (D. 
Theorem [4.111 implies that (per F)x V F'^'^^'ii. Since F'^'^^d = (D it follows that (per F)x V (D. Since at least one 
coordinate of x is non-zero, and x is real, this coordinate is invertible, hence per V (D, which contradicts 
the assumption. 

Let us show the "only if" part. Assume that the columns of A are tropically linearly independent. This 
implies in particular that no column of A consists of elements of T°, that is Assumption 14.61 is satisfied. 
Then, by Theorem 14. 10[ / satisfies Condition ([3]) of Theorem 14.91 that is there exists a vector u G M" and a 
scalar A < such that 

min (— TT^j," -|- max (tt^,;!. + ui.)) ^ A-|-u.,, j G [n] . 

Hence, for every j G [n], we can find an index cr(j) which attains the minimum, and so (cr(j), j) G E and 

-ttA^,j)j - Uj + max (ttA^qa^. -f u^) sC A . 

k£[n\, k^j 

Let Gij :— TrAij + Uj. The latter inequality can be rewritten as 

Ga{j)k - G„(j)j ^ A , J G [n], k&[n], j . 

We claim that a is injective. Indeed, assume by contradiction that i = cr(j') = cr(j") for some j' ^ j". Then, 
by selecting k — j' and j = j" in the previous inequality, we get 

Giji — Gij" ^ A . 

and by selecting k = j" and j = j' we get symmetrically, 

Gij" — Giji A . 

Summing these inequalities, we get ^ 2A < 0, which is nonsense. 

Let / := {o-(j); j G [n]}. We get that the submatrix consisting of the rows of G with indices in / is such 
that the maximum of row (j(j) is attained only at column j. It follows that a^^ determines the unique 
optimal solution of the optimal assignment problem corresponding to this submatrix, that is 

GjCT-i(j) > ^ G„{i) 
iei iei 
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for all bijective maps r : / — [n]. Hence the same holds for the matrix B = it A instead of G. Since 
(i, cr~"'^(i)) G E for all i ^ I, the submatrix F consisting of the rows of A with indices in / satisfies peri^ = 
per(7rF)^ G \ {C}, that is, F is tropically nonsingular. □ 

The classical Radon theorem shows that m + 1 vectors in dimension m can be partitioned in two subsets 
that generate two convex cones with a non-zero intersection. Tropical versions of this result have appeared 
in |But03| IBH04I IABG06| IGM10| IAGG09| . The following result is another Radon analogue, this times in 
the semiring Tq. The proof uses the same method as the one of |AGG09j . 

Corollary 4.13. Any m + 1 vectors o/T™ are tropically linearly dependent. 

Proof. Consider vi, . . . , Wm+i in T™ and denote by B the m x (m + 1) matrix with columns Vj, j £ [to + 1]. 
If one of the m x m submatrices of B is tropically singular. Theorem 14.121 shows that the columns of this 
submatrix are tropically linearly dependent, hence the m+1 vectors wi, . . . , Vm+i are also tropically linearly 
dependent. Otherwise, if A is the square submatrix obtained from B by deleting the last column, and 
b ~ Vm+i, we get that per A is invertible in To and that the vector x := per ^"^^'''^•'5 has all its entries in 
(and non zero). Hence, by Point ^ of Theorem 14. Ill i: is a solution of Ax V b. Denoting by y the to + 1 
dimensional vector obtained by completing x with an to + 1-entry equal to 1, we get that By € T°. Since y 
is a non-zero real vector, this shows that the columns of B are tropically linearly dependent. □ 

Corollary 4.14. Let A G M.m,ni'^c)- Then, the maximal number of tropically linearly independent rows of 
A, the maximal number of tropically linearly independent columns of A, and the maximal size of a tropically 
nonsingular submatrix of A coincide. 

Proof. Assume that A has a tropically nonsingular submatrix of size k. Let F denote the submatrix of A 
formed by the columns of A corresponding to the columns of this submatrix. It follows from the "if" part 
of Theorem 14.121 that the columns of F are tropically linearly independent. Hence, A contains at least k 
tropically independent columns, which shows that the maximal number of tropically linearly independent 
columns of A is greater than or equal to the maximal size of a tropically nonsingular submatrix of A. 

Gonversely, assume that A has k tropically independent columns. Then CoroUarv 14. 131 shows that A: ^ to. 
Let F denote the submatrix of A consisting of these columns. By the "only if" part of Theorem I4.12[ we 
can find a k x k submatrix of F which is tropically nonsingular, which shows the reverse inequality, thus the 
equality between the maximal number of tropically linearly independent columns of A and the maximal size 
of a tropically nonsingular submatrix of A. 

Replacing A by its transpose matrix A*, we obtain the same result for rows instead of columns, which 
finishes the proof of the corollary. □ 

We next give several corollaries of these results for M„iax- Till the end of this section we shall consider 
tropical linear dependence and tropical nonsingularity in Mmax, i-e., in the sense given in the introduction. 

Corollary 4.15. Let A G Mm,n(Mmax) with m ^ n. Then, the columns of A are tropically linearly inde- 
pendent if and only if A has an n x n submatrix, which is tropically nonsingular. 

Recall that the tropical rank of a matrix A G A^m,n(IRmax) is defined as the maximal size of a tropically 
non-singular submatrix. In |AGG09] . we also defined the maximal row (resp. column) rank of a matrix A 
with entries in Mmax as the maximal number of tropically linearly independent rows (resp. columns) of A. 
We get as an immediate corollary of Corollarv l4.14l the equivalence between all these rank notions. 

Corollary 4.16. Let A G M.m.n{!^raax)- Then, the maximal row rank of A, the maximal column rank of A 
and the tropical rank of A coincide. 

Corollary 4.17. Checking whether a matrix A G A^Tn,ri(IRmax); with m ^ n, has tropical rank at least n — k, 
reduces to solving (^.) mean payoff game problems associated to m x {n — k) matrices, and can therefore be 
done in pseudo-polynomial time for a fixed value of k. 

Proof. It suffices to check, for every subset / of [ri\ of cardinality n — k, whether the columns in / of A are 
tropically linearly independent, which, by Theorem 14.91 is a mean payoff game problem. □ 
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Remark 4.18. Recall that checking whether a square matrix is tropically singular can be done in 0{n^) 
time, as observed by Butkovic |But94j . Hence, for a fixed fc, checking whether a matrix has tropical rank 
strictly less than k is also a polynomial time problem (it suffices to check whether all the (™) x submatrices 
of size kxk are tropically singular). However, Kim and Roush showed that the general problem of computing 
the tropical rank is NP-hard |KR05| . 



Example 4.19. Consider the points in ^-^^^^^^ 



3 

m; 

a = (0 2 0) 6 = (0 3 2) c = (O 1 l) d = (l 3 O) e = (l 1 O) 
These points arc represented in Figure [31 The hypcrplanc H defined by the condition that the maximum in 



X3 




Figure 3. Tropical hyperplane passing through the points a, 6, c, d 

the expression 

max(2 + xi,X2, 1 + X3) 

is attained at least twice is represented by the union of three bold half-lines. The points a, 6, c, d belong 
to this hyperplane, but it is easy to check graphically there is no hyperplane containing the five points 
a, b, c, d, e. 

We next show that these conclusions can be obtained by the previous arguments. The game associated 
to the matrix with rows a, b, c, d can be visualized in Figure 01 Recall that in the square states. Player Max 




Figure 4. Game associated with the configurations of points in Figure |3l 



must choose a new circle state different from the previously visited one. The dynamic programming operator 
/ has the three following coordinates: 

/i(a-) :— min(max(2 + X2, X3), max(3 + X2, 2 + 2:3), max(l + X2, 1 + X3), —1 + max(3 + 3:2, 2:3)) 
f2{x) :— min(— 2 + max(a;i, 2:3), —3 + max(a::i, 2 + 2:3), —1 + max(2;i, 1 + 2-3), —3 + max(l + xi, 23)) 
/3(2) :— min(max(2i, 2 + X2), —2 + max(2:i, 3 + 22), —1 + max(2:i, 1 + 2:2), max(l + 21, 3 + 2:2)). 



By applying the power algorithm to the map g{x) = min(/(a;), x), starting from .t" = (0, 0, 0), we compute 
:= g{x^) = (0, —2,0), and := g{x^) — (0, —2, —1), which is a fixed point of g, and so the algorithm 
stops. The coefficients of the fixed point (0, —2, — f ) determine the half-space H containing a, b, c, d. 
Let us now replace the vector d by the vector e. The map / becomes 

fi{x) := min(max(2 + 2:2, 2:3), max(3 + X2,2 + xs), max(l + a;2, 1 + 2:3), — 1 + max(l + 2:2, 2:3)) 
/2(2-) :— min(— 2 + max(2-i, 2:3), —3 + max(2;i, 2 + 2:3), —1 + max(x-i, 1 + 2;3), —1 + max(l + xi, X3)) 
fsix) :— min(max(2-i, 2 + 2:2), —2 + max(2;i, 3 + 2:2), —1 + max(2;i, 1 + 2:2), max(l + xi, 1 + 2:2)). 

The power algorithm, with the same initial condition, gives x^ = (0, —2,0), = (— f, —2, — f), and since 
xf <0 for all i = f,2,3, the power algorithm stops, showing that the vectors a, b, d, e are tropically linearly 
independent. 

4.4. Alternative proof of Theorem 14.121 via the tropical Helly theorem and further comments. 

When m — n, Theorem I4.f 21 can be proved by direct combinatorial means (essentially by network flows 
arguments) as is done in [IzhOSI . We next observe that the m > n case can be reduced to the m = n case 
by means of the tropical Helly theorem, which appeared in the works of Briec and Horvath }BH04| , Gaubert 
and Sergeev |GS07| . and Gaubert and Meunier jGMlOj . with three different proofs. 

Theorem 4.20 (Tropical Helly theorem, |BH04i[GS07llGMfO) ). Let {Ci)i^[ra] denote a collection of tropical 
cones of KJJj^x • V intersection of all the Ci is reduced to the zero vector, then there exists a subcollection 
of cardinality n the intersection of which is also reduced to the zero vector. 

The following corollary shows that the rectangular case (m > n) in Theorem 14.121 can be derived from 
the square case (m = n). 

Corollary 4.21. Let A G Mm.nC^c) with m ^ n has tropical linearly independent columns, then, it has an 
n X n submatrix the columns of which are still tropically linearly independent. 

Proof. We apply the tropical Helly theorem to 

C,^{x(^m.l^^^- A,x^V^ 

where Ai denotes the ith row of A. The set Ci is a tropical cone. Since the map x ^ x^ is not a morphism 
of semirings this is not immediate. But it is a multiplicative morphism, hence Ci is stable by tropical 
multiplication: x £ Ci and A S Rmax imply Aa; G Ci using (Aa;)^ = A^x^. 

To prove that Ci is stable by tropical sum, we shall use Property (^5]) on page [T2] for vectors with entries 
in To. Indeed, as for Te, T" can be endowed with its natural order, u ^ v if there exists w g T" such that 
u ® w = V, which coincide with the pointwise order. Hence, since Property (pS)) holds for scalars in Tc, it 
also holds for vectors with entries in To. Let x,y G Ci, then A^x^ and Aiy^ are in T°. Denote by z = x (By 
the tropical sum of x and y. By Property (|26|) for x and y, we get that x^ ^ z^ ^Si x^ (B ■ Applying 
Ai, which is additive thus order preserving on T", we obtain Aix"^ ^ AiZ^ ^ Ai{x^ y^) = AiX^ ® Aiy^ . 
Replacing x by y and taking the supremum of both inequalities, we get 

Aix"^ V Aiy"^ ^ Aiz"^ ^ © A.y"^ . 

Since AiX^ and Aiy^ are in T", we deduce that AiX^ V Aiy^ = AiX^ © Aiy^ , which together with the 
previous inequality implies that AiZ^ = AiX^ © Aiy^ G T°. This shows that z & d, so that d is a tropical 
cone. 

By definition, the columns of the matrix A arc linearly independent if and only if the intersection of all 
the Ci is reduced to the zero vector. By the tropical Helly theorem, we can find ii < i2 < ■ ■ ■ < in such that 
n • • • n Ci^ = {C}. It follows that the columns of the submatrix F consisting of the rows ii, . . . , i„ oi A 
arc tropically linearly independent. □ 

Remark 4.22. The difficulty of computing the tropical rank is related to the lack of matroid structure, 
see IDSS05I § 7]. 
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